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Abstract 

We introduce the two user finite state compound Gaussian interference clian- 
nel and characterize its capacity region to within one bit. The main contributions 
involve both novel inner and outer bounds. The inner bound is multilevel super- 
position coding but the decoding of the levels is opportunistic, depending on the 
channel state. The genie aided outer bound is motivated by the typical error events 
of the achievable scheme. 



1 Introduction 

The focus of this paper is the communication scenario depicted in Figure [H Two transmitter- 
receiver pairs communicate reliably in the face of interference. The discrete time complex 
baseband model is: 

yi[m] = hiixi[m] + h2iX2[m] + zi[m], (1) 
y2[m] = hi2Xi[m] + h22X2[m] + Z2[m\. (2) 

Here m is the time index, is the signal at receiver k while Xk is the signal sent out by 
the transmitter k (with k = 1,2). The noise sequences 2;2[?ti]}j^ are memoryless 

complex Gaussian with zero mean and unit variance. The transmitters are subject to 
average power constraints: 

TV 

Y,\MH' <NPk, A; = 1,2, V7V>1. (3) 

m=l 

The complex parameters {h^n^l = 1,2, A; = 1,2} model the channel coefficients between 
the pairs of transmitters and receivers. They do not vary with time but the transmitters 
and receivers have different information about them: 



• Receiver k is exactly aware of the two channel coefficients hik,h2k', this models 
coherent communication. 

• Transmitters are only coarsely aware of the channel coefficients: the transmitters 
know that the channel coefficients belong to a finite set. Specifically, both the 
transmitters know that 

{hik,h2k) e Ak, k=l,2. (4) 

This models potential partial feedback to the transmitters regarding the channel 
coefficients. 



A more general compound channel model allows for all four channel parameters to jointly 
take on different choices: 

(/iii,/ii2,/i2i,/i22) e A. (5) 

However, since the receivers do not cooperate in the interference channel, it turns out 
that the setting in Equation ([5]) is no more general than the one in Equation (jlj). This is 
explored in Section [HI 




Figure 1: The two user Gaussian interference channel. 

The key problem of interest is the characterization of the capacity region: the set 
of rate pairs at which arbitrarily reliable communication between the two transmitter- 
receiver pairs. The "compound" aspect of the channel is in insisting that the receivers be 
able to decode the messages of interest with arbitrarily high probability, no matter which 
of the finite states the channel coefficients take on. Our main result is a characterization 
of the capacity region up to one bit. 
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A special instance of the problem studied here is the classical two user Gaussian 
interference channel: in a recent work, Etkin, Tse and Wang [1] showed that a single 
superposition coding scheme (a specific choice among the broad class of schemes first 
identified by Han and Kobayashi [1]) achieves performance within one bit of the capacity 
region. The transmission involved splitting the data into two parts - one public and the 
other private - and linearly superposing them. The idea is that the public data stream 
is decoded by both the receivers while the private data stream only by the receiver of 
interest. The key identity of the proposed superposition scheme is the following: the 
power allocated to the private stream is such that it appears at exactly the same level as 
the background noise at the unintended receiver (the idea is that since the private data 
stream is being treated as noise at the unintended receiver, there is no extra incentive 
to reduce its level even further than that of the additive noise). A novel outer bound 
developed in [1] showed that this simple superposition scheme is within one bit of the 
capacity region. 

Implementation of the specific superposition scheme proposed above requires each 
transmitter to be aware of the interference level it is causing to the unintended receiver. 
In the context of the compound channel being studied here, the transmitter is not aware of 
the interference level; this poses an obstacle to adopting the idea of appropriately choosing 
the power level of the private data stream. One possibility could be to set the power level 
of the private data stream based on the strongest interfering link level (among the set of 
possible choices) - this would ensure that it is only received below noise level when the 
interfering link level takes on the other possible choices. However, this approach might 
be too pessimistic and its closeness to optimality is unclear. 

We circumvent this problem by proposing the following novel twist to the general 
superposition coding scheme. Our main idea is best described when the interference links 
{hi2 and h2i in Figure [1]) take on only two possible values and the direct links are fixed 
(i.e., the sets Ai and A2 have cardinality of two, cf. Equation (jl])). We now superpose 
three data streams at each transmitter. Two of them, public and private, are as earlier: 
all receivers in all channel states decode the public message while only the receiver of 
interest decodes the private message (no matter the channel state, again). The novelty 
is in the third data stream that we will call semi-public: this data stream is decoded by 
the unintended receiver only when the interference link is the stronger of the two choices 
(and treated as noise otherwise). As such, this data stream is neither fully private nor 
public (the unintended receiver either treats it as noise or decodes it based on the channel 
state) and the nomenclature is chosen to highlight this feature. 

The power split rule is the following: the power of the private stream is set such that 
at the higher of the interference link levels, it is received at the unintended receiver at 
the same level as the additive noise. The power of the semi-public data stream is set such 
that it is received at the unintended receiver at the same level as the additive noise only 
when the interference link level is at the lower of the two possible choices. The rationale 
is that the semi-public data stream is not decoded only when the interference link level 
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is at the lower of the two possible choices, and thus it can transmit higher power than if 
its power is restricted by the higher of the interference link levels. This approach scales 
naturally when the interference link levels can take on more than two possible choices 
(the number of splits of the data stream is one more than the cardinality of the set of 
possible choices). 

We derive novel outer bounds to show that our simple achievable scheme is within 
one bit of the capacity region. Our outer bounds are genie aided and are based on the 
clues provided by the typical error events in the achievable scheme. This approach sheds 
operational insight into the nature of the outer bounds even in the noncompound version 
(thus eliminating the "guesswork" involved in the derivation, cf. Section IV of [5]). 

The paper is organized as follows: we start with a simple two-state compound inter- 
ference channel. In this setting, both the direct and interference link levels can take on 
only one of two possible values (so the sets Ai and A2 have cardinality two). Using a 
somewhat abstract setting (described in Section [2]) that features the Gaussian problem 
of interest as a special case, we present our main results (both inner and outer bounds) 
for this two-state compound interference channel. Our definition of the abstract setting 
is motivated by that chosen in [5] and could be viewed as a natural compound version of 
the interference channel studied by Telatar and Tse [5] . This is done in Section [3l We 
discuss the insights garnered from these results in the context of the simpler noncom- 
pound interference channel in Section [61 Next, we are ready to set up the model and 
describe the solution the more general finite state interference channel; we do this first 
in the abstract setting (Section [7j) followed by specializing to the Gaussian scenario of 
interest (Section [S]). 



2 Model 

Consider the two-user, two-state compound memoryless interference channel depicted in 
Figure [2l There are two transmitters which want to reliably communicate independent 
messages to two corresponding receivers. The input to the channel from the first trans- 
mitter at any discrete time Xi G Xi passes through a degraded discrete memoryless 
broadcast channel: the two outputs of the degraded broadcast channel are 5*10, G Si and 
(the degraded version) G Si. Similarly, at any time, the input to the channel from 
transmitter 2 X2 E X2 produces £ S2 and a degraded version 5*2/3 £ of it. The 
channel to any one of the two receivers is decided by the state of that receiver: here there 
are only two states a and (3. Once the state is decided, it is fixed for the entire duration 
of communication. When the first receiver is in state a, the output at any time is 

Yia = fla{Xi,S2a)eyi. (6) 

Similarly, when the first receiver is in state /3, the output at any time is 

Yip = MXi,S2p)eyi. (7) 
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Figure 2: A two-state compound channel model. 

Here fia and are deterministic functions such that for every xi G Xi,S2 G ^2, and 
r] = a,l3, the following function is invertible: 

.) : ^2 ^ 3^1. 

Likewise, the outputs of user 2 under the two possible states the channel to it can take 
are defined using similar deterministic functions /2a and f2fs- 

We allow each receiver to be in potentially different states, and they are both aware 
of the state they are in. A pair of communication rates {Ri,R2) is said to be achievable 
if for every e > 0, there are block length n encoders, 

encfc : {1, . . . , Mfc} ^ X^, > 2"(^'=-^\ = 1, 2, (8) 

and decoders 

deCfc^:3^,"^{l,...,Mfc}, fc = l,2, r/ = a,/3, (9) 

such that 

Pr (decfc,,(n';) =mk, k = l,2, r] = a,/3\X^ = encfc(m,), k = l,2)>l-e. 

(10) 

We are interested in the capacity region C, which is the set of all achievable R2) pairs. 
We can make a few observations: 
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The channel described here can be thought of as a natural generalization of that 
studied in [5]. 

An important special case occurs when the channels PSka\Xk ^"^^ PSkp\Ska deter- 
ministic for both k = 1,2. This channel is a compound version of the deterministic 
channel considered by El Gamal and Costa P] with the interference in state being 
a deterministic function of the interference in state a. 

The compound Gaussian interference channel, with the cardinality of both the sets 
Ai and A2 restricted to 2 (in the notation introduced in Section [1]), is a special 
instance of the model in Figure [2j We start with a compound Gaussian interference 
channel with 

(/ill, h2l) G {(/ilia, /i21a), (/'-ll/S, /i21/3)} , 
(/i22, hi2) G {(/i22a5 hi2a) , (/i22/35 ^12/?)} ■ 

Further, without loss of generality, we can assume that 

(11) 
(12) 

With the following assignment, we see that the model in Figure [2] can capture the 
Gaussian model in Figure [1) 



/^21a 


> 


^21/3 


/il2a 


> 


/il2/3 




h 



12/3 



'-12a 



1/2 



^2, 



h 



21/3 



i21a 



1/2 



(13) 

(14) 
(15) 

(16) 



^lo 

Yip 

Y2a 
Y2P 



/iq(-^I) 'S'2a) 
/2a (^2) 'S'l 

a ) 

/2/3(^2, Sip) 



hllaXi + S2a) 
hujjXi + 5*2/3, 
/i22a-^2 + 5*10,, 
/i22/3^2 + 5*1/3. 



(17) 
(18) 
(19) 
(20) 



Here Zi,Z[,Z2 and are independent complex Gaussian random variables with 
unit variance. 



Main Result 



ur main results on the 2-state compound interference channel are the following. 
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• We first show the performance of an achievable scheme and hence characterize an 
inner-bound; 

• next, we give an outer-bound to the capacity region and quantify the gap between 
the outer-bound and the achievable scheme; 

• specializing to the compound deterministic interference channel, we completely char- 
acterize the capacity region; 

• specializing to the compound Gaussian interference channel, we characterize the 
capacity region up to a gap of 1 bit (at all operating SNR values and all channel 
parameter values). 

3.1 Inner-bound: Achievable Scheme 

The achievable scheme is characterized by P, the set of random variables 

{Q,Xi,Uia,Uii3,X2,U2a,U2i3), (21) 

such that the following Markov chain is satisfied: 

Uli3 — Uia — Xi — Q ~ X2 — U2a — f^2/3- 

Alternatively, the joint probability distribution function factors as 

p{q, Xi,, MiQ, Ml/3, X2, U2a, ^2/?) =p{q)p{xi\q)p{uia\xi)p{ui^\uia)p{x2\q)p{u2a\x2)p{u2p\u2a) ■ 

(22) 

Our achievable scheme is a multilevel superposition coding one and can be viewed as 
a generalization of the two-level superposition coding scheme of Chong et al. [3]. The 
random coding method can be intuitively described as follows, using the "cloud-center" 
analogy from Cover and Thomas (Section 14.6.3, [S]); a formal statement and its proof 
follow later. The random variables Uip and U213 are used to generate the outermost code 
books (with rate R1/3 and i?2/3, respectively) for the two users. These messages encoded 
via these code books are decoded by both receivers and, as such, can be interpreted as 
public information. Next, the random variables Uia and U2a are used to generate the 
next level of code books (with rate Ria and i?2a, respectively). The messages encoded 
via these code books are decoded by the receiver with stronger interference (i.e. Rx^^) 
but treated as noise by the receiver with weaker interference (i.e. Rx^^); as such, these 
messages can be viewed as semi-public information. Finally, the messages encoded via the 
inner most code books (rates Rip and i?2p) are only decoded by the receiver of interest; 
thus this constitutes private information. 

Given P eV, we define the six- dimensional region 

nfJiP) ^ {{Rip, Rip, R2p, R2a, R2p) : satisfying m ' dSS])} . (23) 
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Rip<I{Yifi;Xi\Uia,U2p,Q) =711 (24) 

R2p + Rip<I{Yip;Xi,U2p\Uic>,Q) =712 (25) 

Ric. + Rip<I{Yip;Xi\Uif3,U2f3,Q) =713 (26) 

R2p + Ric. + Rip<I{Yip;Xi,U20\Uifi,Q) =714 (27) 

Rip + Ric. + Rip<I{Yip;Xi\U20,Q) =715 (28) 

R2(} + Rip + Ric. + Rip<I{Yip;Xi,U2^\Q) =716 (29) 

i?lp </(na;^l|C/la,C/2a,0) =(511 (30) 

R2c.+Rlp<I{Ylc.;Xi,U2c.Uic.,U20,Q) =Sl2 (31) 

i?2/3+i?2a+i?lp </(na;^l,C/2a C/la,0) =^13 (32) 

Ric. + Rip<I{Yic;Xi\Uip,U2a,Q) =Si4 (33) 

R2a+Rlc.+Rlp<I{Ylc.;Xi,U2c.Uip,U2p,Q) =Si5 (34) 

R213 + R2a + Rla + Rip < I{Yla', Xi,U2a Uip,Q) =(^16 (35) 

i?l/3+i?la+i?lp </(>"la;^l|t/2a,0) =^17 (36) 

-R2Q + -Rifj + + -Rip < /(Yiq; ^1, ?72q C/2/3, Q) =^18 (37) 

-^2/3 + ^2q + -Rl^ + -RlQ + -Rip < -^(^la; -'^l, C^2q Q) =^19 (38) 

R2p<I{Y2(3;X2\U2c.,Uip,Q) = 721 (39) 

Rip+R2p<I{Y2l3;X2,Uip\U2c.,Q) = 722 (40) 

R2c.+R2p<I{Y2p;X2\U20,Ui0,Q) = 723 (41) 

Rifi+R2^ + R2p<I{Y2p;X2,Ui^\U2p,Q) =724 (42) 

i?2;3+i?2a+i?2p </(>2;3;^2|(7i^,Q) = 725 (43) 

Rl(} + R2f3 + i?2a + i?2p < I{Y2p; X2, Uif3\Q) = 726 (44) 

R2p<I{Y2c.;X2\U2a,Uic.,Q) =(521 (45) 

Rlc.+R2p<I{Y2c.;X2,Uic.\U2c.,U,p,Q) =622 (46) 

Rl0+Rla+R2p<I{Y2c.;X2,Uic.\U2a,Q) =S23 (47) 

R2c.+R2p<I{Y2c.;X2\U20,Uic.,Q) =S24 (48) 

Rla+R2c.+R2p<I{Y2c.;X2,Uic.\U2p,Uip,Q) =625 (49) 

Rip + Rla+R2c.+R2p<I{Y2c.;X2,Uic.\U2p,Q) =(526 (50) 

i?2/3+i?2a+i?2p </(>"2a;^2|t/la,Q) =(527 (51) 

i?la+i?2/3+i?2a+i?2p </(>"2a;^2,C/la|t/l/3,Q) =(528 (52) 

i?l/3+i?la+i?2/3+i?2a+i?2p </(>"2a;^2,t/la|(3) =^29 (53) 

Rlp + Rla+Rip > (54) 

R2P + R2C. + R2P > 0. (55) 
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We define the two-dimensional region, 



nUP) ={{Ri,R2): 




(56) 



In other words TZin{P) is the projection of the six-dimensional polytope 7ll^ {P). One 
approach to take the projection, is to do the Fourier- Mot zkin elimination, as done for the 
basic superposition coding scheme in the context of the regular (noncompound) interfer- 
ence channel [3]. Doing this explicitly is rather cumbersome as the inequalities here are 
much more in number than the inequalities that were handled by Chong et al. in [3]. 

Theorem 1 The capacity region C satisfies 



Proof: A formal description of the achievable scheme and the proof of this theorem are 



Particularizing, we restrict ourselves to a subset of V defined as follows. Given random 
variables {Q, Xi, X2) such that Xi and X2 are conditionally independent when conditioned 
on Q, we define random variables Uia and Uip which take values in Si, and and U213 
which take values in S2. They are jointly distributed with {Q, Xi, X2) according to the 
conditional distribution 

p{Uia,Uii3,U2a,U2i3\q,Xi,X2) = 



Note that, conditioned on Q, we have the following two Markov chains, with the sets of 
random variables involved in the two chains being conditionally independent. 



Our choice is motivated by the choice in the paper by Telatar and Tse [5]. Every member 
of this family is uniquely determined by joint random variables {Q, Xi, X2) such that 
Xi — Q — X2 is a Markov chain. We will henceforth denote the corresponding regions 



RZ' (P) by RZ' {Q,Xi,X2) and Rin{P) by Rin {Q, Xi, X2). We now have the natural 




(57) 



available in Section HTTl 



□ 



PSi. |Xi(^^lakl)PSi^ 151.(^^1/3 1 ^^la)p52c (W2a 1X2)1)52^ 152.(^2/3 1 M2a). 

(58) 



Uli3 — Uia — Xi — Sia — Sij3 
U2P — U2a — X2 — S2a — S2f3- 



result: 
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Corollary 2 

CD U 7^i„,(Q,Xl,X2), (59) 

Q,Xi,X2 

where the union is over all (Q, Xi, X2) such that Xi — Q — X2 is a Markov chain. 

Proof: Follows directly from Theorem [H □ 

We observe that the Fourier-Motzkin elimination procedure to implement the projec- 
tion operation in obtaining TZin{Q, Xi, X2) would yield only a finite set of inequalities. 
Further, the right hand sides of these inequalities would be linear functions of p{q) and 
for a fixed Q = qo the right hand sides form a closed set of finite dimensions. Thus, by 
Caratheodory's theorem, we can conclude that the cardinality of Q can taken to be finite 
without loss of generality in the union in Equation fl59|l . 



3.2 Outer-bound 

Theorem 3 For every {Q, Xi, X2) such that Xi — Q — X2 is a Markov chain, there is a 
region TZout{Q ^^1^X2) C such that the following are true: 

(i) 

CC y 7^o„^(Q,Xl,X2), (60) 

where the union is over all ((5,Xi,X2) such that Xi — Q — X2 is a Markov chain. 
(11) If {Ri, R2) e TZoutiQ, Xi, X2), then (i?i - Ai, i?2 - A2) G 7^^„(Q, Xi, X2), where 

Ai{Q,X,,X2)=max{I{X2;S2a\U2a)J{X2;S2i3\U2i3)), (61) 
A2(g, X,, X2) = max(/(Xi; S^^\U,^), I{X^- S^pp^p)), (62) 

in which the random variables are jointly distributed according to fl58l) and the chan- 
nel conditional distributions. 



Proof: Part(i) is proved in Section [STTl Part(ii) is proved in Section [5?2l □ 

The set TZoutiQ, Xi,X2) is defined in Section [STTl Our definition is motivated by the 
external representation of 7^j„((5, Xi, X2) that we obtain in Section I4l2l 
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3.3 Special Cases 



Our model captures two important special cases: 

• the compound deterministic interference channel; 

• the compound Gaussian interference channel, 

as discussed in Section |2j Thus our results apply to these cases (readily for the determin- 
istic channel, and with an appropriate approximation result to the continuous alphabet 
Gaussian channel). Moreover, the structure afforded by these special cases allows us to 
derive further insight into the nature of the general results derived earlier. 

3.3.1 Compound Deterministic Interference Channel 

In this instance, the capacity region is exactly described. 

Corollary 4 For the deterministic compound interference channel, the inner bound in 
TheoremU\is the capacity region. 

Proof. The proof is elementary. When the channel is deterministic, we see that the gap 
claimed by Theorem [3] 



3.3.2 2-state Compound Gaussian Interference Channel 

For the Gaussian version, we can characterize the capacity to within one-bit. 

Corollary 5 For the 2-state compound Gaussian interference channel, the achievable 
region of TheoremUl is within at most one bit of the capacity region. 

Proof. For the Gaussian channel, each of the mutual information terms in the expressions 
for Ai{Q, Xi, X2) and A2{Q, Xi, X2) can be upper bounded by 1 bit. To see this, note 
that Sia = hiaXi + Nia and Uia = hi^Xi + N[^, where Nia and are independent 
and identically distributed memoryless complex Gaussian random variables. Hence 




(63) 



This completes the proof. 



□ 
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Similarly, 



I{X,;Si^\U,^) < 1, 

IiX2;S2a\U2a) < 1, 

IiX2;S2fs\U2fs) < 1. 



(64) 
(65) 
(66) 



□ 



Additionally, we can use Gaussian code books to get to within one bit of the capacity. 



Corollary 6 For the 2-state compound Gaussian interference channel, 



where Q* = 1, X* ~ CA/'(0, Pi), X* ~ CAf{0, P2). 

This implies that TZin{Q* , X^, X2) is within one-bit of the capacity region C of the 
2-state Gaussian compound interference channel. 



4 An Achievable Scheme 

We will present a natural, and novel, achievable scheme first. We will evaluate the set of 
reliable communication rates using this strategy and hence characterize an inner bound 
to the capacity region; this will complete the proof of Theorem [H Next, we will see some 
important geometric properties of the achievable rate region. 



Our coding scheme is a natural generalization of the scheme of Chong et al. j3]. Since 
there are two possible states for both receivers, each encoder now sends two sets of com- 
mon information, with the receivers opportunistically decoding the common information 
(depending on the state), we choose the random variables corresponding to the two sets of 
common information in a degraded manner, following the same ordering of degradedness 
of the interferences under the two states (c.f. 



C C TZoutiQ* , XI, X2) 



(67) 



Proof See Section [5731 



□ 



4.1 Proof Of Theorem [T] 



k iJka iJk/B 



k 



1,2). 



(68) 



Fix a P e V. 
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Codebook Generation 



Generate a codeword of length n, generating each element i.i.d. according to n[L^p(gj). 
For the codeword Q", generate 2"'^'^'^ independent codewords 

WO' JiG{l,2,---,2"^^n, (69) 

generating each element i.i.d. according to n"^^p(Mi/3i|gj). For each of the codewords 
U'^l^iji), generate 2"^^" independent codewords 

U^Juh), A;iG{l,2,---,2"^-}, (70) 

generating each element i.i.d. according to Il'^=ip{uiai\uii3i, qi). For each of the codewords 
^io(ii'^i)' generate 2^^^^ independent codewords 

^r(ji,^i,/i), /iG{l,2,---,2"^^-}, (71) 

generating each element i.i.d. according to II^L^p (xi|tiiaj, ^1/3,, g^). 

Similarly generate code books 

UU3^), J2e{l,2,---,2"^^n, (72) 

U^aU2,h), fc2G{l,2,---,2"«-}, (73) 

X^U2,hJ2), /2G{l,2,---,2"^^''}. (74) 



Encoding 



Transmitter Txi sends X"(ji, /ci, /i) to communicate the message indexed by {ji,ki,li). 
Transmitter Tx2 sends X2 (^21 ^21 h) to communicate the message indexed by (^2, ^21 ^2)- 



Decoding 



The receivers do joint typical set decoding. Let Ae {^) denote the set of jointly typical 
sequences where Q is the probability space containing the entire collection of random 
variables. 

Receiver Rxi/3 determines a unique (^ji, ki, li^ and any j2 such that 

{q\ u^f, (ji) , f/r, (3i, h) , {j„ h, h) , u^^ (J2) , yr^.) e 

^^"^ {Q,U,p,U,^,X,,U2p,Y^p). 

It declares an error if it fails to find such a choice. 
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Receiver Rxi^ determines a unique yji,ki,lij and any \^j2,k2j such that, 

(Q^ u^^ (ji) , t/r, (ii, ^i) , (ji, /i) , f/^"^ (3-2) , ^2) , n"/.) G 

(g, Uif,, Ui^, Xi, ?72«, Fla). 

It declares an error if it fails to find such a choice. 

Similar decoding is done by receivers RX2/3 and Rx2a. 

From the analysis of the probability of error, we show in Appendix |X] that the rate 
vector (-Rip, -Rio, -R1/3, -R2p, -R2a, R213) is achievable if it satisfies the following conditions: 



Rip<IiYi0;Xi\Uia,U2p,Q), ifi?ip>0, (75) 

i?2/3 + i?lp < /(n/3;^l,f/2/3|C/i„,Q), ifi?ip>0, (76) 

Ria + Rip<I{Yi0;X,\Uip,U2p,Q), if + i?ip > 0, (77) 

R20 + Ria + Rip<I{Yip;Xi,U2p\Ui0,Q), if + i?ip > (78) 

Rip + Ria + Rip<I{Yi0;Xi\U2p,Q), if Rm + Ria + Rip > 0, (79) 

R2P + Rip + Ria + Rip < I{Yii3;Xi, U2p\Q), if Rif3 + Ria + Rip > 0, (80) 









Rip 


<I{Yla:Xi 


Ula,U2a,Q), if -Rip > 0, 


(81) 






R2a - 


hi?ip 


<I{Yia;Xi 


U2a\Ula,U2p,Q), if i?lp > 0, 


(82) 




-R2/3 


+ R2a - 


hi?ip 


<I{Yia;Xi 


U2a\Ula,Q), ifi?lp>0, 


(83) 






Ria - 


hi?ip 


<I{Yia;Xi 


Uip,U2a,Q), if -RiQ + -Rip > 0, 


(84) 




R2a 


+ Ria - 


hi?ip 


<I{Yia;Xi 


U2a\Uip,U2p,Q), if i?l„ + -Rip > 0, 


(85) 




\- Ria 


+ Ria - 


I- -Rip 


<I{Yla.Xi 


U2a\Uip,Q), if i?i„ + i?ip > 0, 


(86) 




Rip 


+ Ria - 


- -Rip 


<I{Yia;Xi 


U2a, Q), if Rip + Ria + -Rip > 0, 


(87) 


-R2a - 


'rRip 


+ Ria - 


- -Rip 


<I{Yia;Xi 


U2a\U2p,Q), if -Rl/3 + -RlQ + -Rip > 0, 


(88) 


R2P + R2a - 


\- Rip 


+ Ria - 


- -Rip 


<I{Yia;Xi 


U2a\Q), if -Rl/3 + -Ria + -Rip > 0, 


(89) 



-R2p < I{Y2p;X2\U2a, Uip, Q), if -R2P > 0, (90) 

-R1/3+-R2P < -r(y2/3;^2,f/l/3|C/2a,Q), if -R2p > 0, (91) 

R2a+R2p<I{Y2p;X2\U2p,Uip,Q), if -R2a + i?2p > 0, (92) 

Rip + R2a+R2p<I{Y2p;X2,Uip\U2p,Q), if -R2a + i?2p > 0, (93) 

R2p + R2a+R2p<I{Y2p;X2\Uip,Q), if R2P + R2a + R2p > 0, (94) 

Rip + R2P + R2a+R2p<I{Y2p;X2,Uip\Q), if -R2/3 + i?2a + -R2p > 0, (95) 
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R2p<I{Y2a;X2\U2aMic.,Q), if i?2p > 0, (96) 

Rla+R2p<I(Y2a;X2,Ulo.\U2a,Ul0,Q), if i?2p > 0, (97) 

RiP + Rla+R2p<I{Y2a;X2,Uia\U2a,Q), if i?2p > 0, (98) 

R2a+R2p<I(Y2a;X2\U2p,Uia,Q), if i?2a + i?2p > 0, (99) 

Rlc,+Raa+R2p<I{Y2a;X2,Ulo,\U2f3,Ulf3,Q), if i?2a + i?2p > 0, (100) 

Rlf3 + Rla + R2a + R2p < IiY2a', X2,Uia\U2/3,Q), if i?2Q + -^2^ > 0, (101) 

R2p + R2a+R2p<I{Y2a;X2\Uia,Q), if i?2/3 + i?2a + i?2p > 0, (102) 

Rla + R2P + Raa + R2p < I{Y2a',X2,Uia\Uip,Q), if i?2/3 + -R2a + ^2p > 0, (103) 

i?l/3+i?la+i?2;3 + i?2a+i?2p </(i"2a;^2,t/la|Q), if i?2/3 + i?2a + i?2p > 0, (104) 



Rip > 0, 

Rla > 0, 
i?l/3 > 0, 

R2p > 0, 

i?2a > 0, 
R2P > 0. 



(105) 
(106) 
(107) 
(108) 
(109) 
(110) 



Note that fl75l) - fl80l) are the decodabihty conditions at Rxi/3; (18T]) - (|89|) are the decod- 
abihty conditions at Rxi^; (I90l)- fl95l) are the decodabihty conditions at RX2/3; f l96|) - (11041) 
are the decodabihty conditions at Rx2q and (llOSp - dllOp are stating the fact that the rates 
are nonnegative real numbers. 

Define 

n^JiP) = {{Rip, Rla, Rifs, i?2p, R2a, R2fs) : satisfics dlSD-dnni)} , (111) 
and its projection onto the two dimension space (i?i,i?2) by 72.j„(F). 

Lemma 7 

Proof: See Appendix El □ 
Thus, we have shown that the capacity region C satisfies 

cd\J n,n{P). (112) 
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In particular, restricting to a subfamily of P, where given random variables {Q, Xi, X2) 
such that Xi — Q — X2 is a Markov chain and {Uia, Uip, U2a, U213) are defined by (!58|) . we 
get 

y 7^,„(Q,Xl,X2). (113) 
This completes the proof of Theorem [H □ 



4.2 Geometric Properties Of 7?^i„ (Q, Xi, X2) 

We have noted earlier that it is tedious to characterize TZin{Q ■, Xi, X2) explicitly. Nev- 
ertheless, we would like to derive some useful insights into the geometric properties of 
IZin {Q, Xi, X2). These will prove useful in deriving the outer bound. 

We begin by noting that TZm {Q, Xi, X2) is a closed and bounded convex region. (In 
fact, we know that it is a polyhedron.) The extremal representation theorem of classical 
Convex set theory (see Theorem 18.8, [7]) states that "an n-dimensional closed convex 
set in M" is the intersection of the closed half-spaces tangent to it" . Thus, 

7^^„(g,Xl,X2) = {{Ri,R2):aR, + bR2<c*{a,b\{Q,Xi,X2)), V(a,6) gR^}. (114) 

Here, c* {a,b\{Q, Xi, X2)) is the support function (Section 13, [7]) of 7lin{Q, Xi, X2) and 
is defined as the solution of the following linear program. 

Max aRi + bR2, (115) 

s.t. {RuR2)eRin{Q,X^,X2). 

Since TZm {Q, Xi, X2) is the projection of the six-dimensional region TZf^ {Q, Xi, X2), the 
linear program flllSp is equivalent to the following linear program. 

Max aRip + aRia + aRip + bR2p + foi?2a + bR2/3, (US) 

s.t. {Rip, Ria, RljS, R2p, R2a, R2/3) ^ Rin (Q ^ -^1^ -^2) ■ 

The dual of the linear program in Equation flll6p sheds important geometric infor- 
mation. Let us denote the dual- variables associated with the inequalities (!24l) -(!29l) by 
z/n, . . . , 1/16, with by /m, . . . ,/ii9, with (^-^ by //21, • • • , 1^26, with (^-^ 

by /i2i, . . . , /i29 and with (I54l)-(l55l) by ui and U2- 

Define A^a,b) C M^^ by, 

A(a,6) = {{{^l^}'i,{^^l^}l{'^2^}'i,{l^2^}l,{^^}^) ■ Satisfying (HH)) - (HMD } . (117) 
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^ z^ii + ^ /Uli - c^i = a (118) 
1=1 1=1 

6 9 

^ I^li + ^ /ili + (/i22 + Ai25 + 1^-28) + (^23 + ("26 + ^^29) - UJl = a (119) 
6 9 

^J^H + ^/iH + (/i23 + ^26 + /^29) + (1^22 + /^24 + /^26) - = d (120) 

6 9 

^ i^2i + ^ ^2i - t^2 = b (121) 

i=l i=l 

6 9 

X] + ^ ^J'2i + (/il2 + /il5 + /^is) + (/^13 + Z^ie + Ail9) - u;2 = (122) 

j=3 j=4 
6 9 

X]'^2i + ^/i2i + (/il3 + ^16 + /^19) + (j^l2 + Z^14 + '^16) -^2 = & (123) 

> 0. (124) 

For any A G A((j define 

2/6 9 \ 

il.)(^?>^i,^2) ^ J2 E^^-^^r. + Em^-^ • (125) 

j=i \i=i i=i ) 



The dual linear program is 



min cj^l^,)(g,Xi,X2), (126) 



suchthat A G ^{a,h)- 
By the strong duality theorem 

c* (a,6|(g,Xi,X2)) = min{cj^i,)(Q,Xi,X2)|A G A(a,6)} . (127) 

Therefore, 

{(i?i,i?2) :ai?i + 6i?2 <c* (a,6|(Q,Xi,X2))} = 

fl {(i?i,i?2) : ai?i + 6i?2 < c|;';i,)(Q,Xi,X2)} 

(128) 

Using (11141) and fll28p . 7?.j„(Q, Xi, X2) can now be described as, 

VAGA(a,fe), V(a,6)GM2}. (129) 
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7^,„(Q,Xl,X2) = {(i?i,i?2) : ai?i + hR-, < cj;"^ ,JQ, Xi, X2) 



The set of linear inequalities (c.f. fll29p ) that is used to describe TZmiQ, Xi,X2) is very 
large and many of the inequalities might be redundant. The following result, Lemma [H 
tries to characterize some of these redundant inequalities. 

Let be a subset of A(^a,b) defined by 

A(a,fe) - ^ ^K") : a;i = 0, a;2 = 0} . (130) 

Lemma 8 

nUQ,X,,X2) = {(/2i,i?2) : i?i > 0, i?2 > 

aR, + bR2 < c[;"i,)(Q,Xi,X2), VA e A'(,,), Va > 0, 6 > 0}. 

(131) 

Proof: Every inequality used to define 7lin{Q, Xi, X2) in fll29p is described by param- 
eters (a, 6) and A G ^(a,b)- Note that this set of inequalities includes the following two 
inequalities: 

-Ri < (132) 
-R2 < 0. (133) 



Consider any inequality, other than the two special ones above, described by (a, b) and 
A G A(a,fe), such that A ^ Aj^ j^^: 

aR^ + bR2<c^;;:l,y (134) 

Define 

{a,b) = {a + uJi,b + U2). (135) 



Consider A G Aj^^) obtained by replacing ui and U2 in A by 0. Now we have 



^{in) (in) 



(136) 



Therefore 



(a + LO^)R, + {b + U2)R2 = ~aR, + ^ < cjg = cj^i (137) 

The above inequality, along with i?i > and R2 > 0, implies (11341) . Therefore we have 
that (11341) is redundant. 

Thus we have proved that inequalities that are characterized by a A ^ ^(afe) 
redundant and can be removed. It also follows from (I118p - (I124I) that ^'(^^t) empty 
set if either a or b is less than 0. Thus we only need to consider inequalities characterized 
by (a, b), where a > and b > 0. This completes the proof. □ 

We also state the following proposition, that will be used in proving the outer bound. 
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Proposition 1 For any A G ^[ab)' 

ifJ-u + /ii2 + /ttis) + (i^ii + 1^12) = 

(/xi4 + /ii5 + /iie) + (^22 + yU25 + fJ'-is) + (1^13 + 1^14) = 

(//2I + 1^22 + /^23) + (1^21 + 1^22) = 
(/U24 + /i25 + ^26) + (^12 + fJ'15 + AUs) + (1^23 + i^24) = 

Proof: The proof follows directly from f lll8p -( fT23|) . 



(/i22 + At23 + /i25 + ^26 " 


h ^28 + fJ'29) 




(138) 


(z/22 + Z^24 + i^26) 


(139) 


(/il2 + /^13 + /^15 + Ail6 - 


h ^18 + /^ig) 




(140) 


(i^i2 + ^^14 + i^ie)- 


(141) 




□ 



5 Outer Bound 



Our goal in this Section is to show that, if (-Ri, -R2) is achievable then there exist random 
variables {Q, Xi, X2), where — Q — ^2 is a Markov chain, and a region 

noutiQ,Xi,X2) = {(i?i,i?2) : i?i > 0, i?2 > 

aR, + bR2 < c^^^\^{Q,X^,X2), VA G A'(,,,), Va > 0, 6 > 0}, 

(142) 

such that 

(i?i,i?2) G7^„„i(Q,Xl,X2). (143) 

The term c^"xab)(Q^ ^2) is defined in Section [STTl Note that our definition of TZoutiQ, Xi, X2) 
is inspired by the characterization of 7lin{Q, Xi, X2) that we have obtained through 
Lemma [HI 

Further, quantifying the difference between c|^"^ j-)((5, ^1, ^2) and c|^"^^^^((5, Xi, X2) 
will give us the gap between the inner and the outer bounds. 



5.1 Proof Of Theorem [3] (i) 



Suppose there is a sequence of encoders at rates (i?i, R2), sequenced by the block length 
n, and decoders with probability of error going to as n — > 00. Fix the block length 
n and consider the corresponding code book. Let X'^, X^, S*", 6*2 , Y^, Y2 be the random 
variables induced by the channel and encoders for uniformly distributed messages, in- 
dependent across the two users. We define random variables f/"^, which is obtained by 
passing X^ through an independent copy of the channel psj^^\Xi, and U^^ by passing the 
so obtained through an independent copy of rhe channel Psip\Sia- Similarly, we also 
define 1/2^ and U2S from X2 and independent copies of ^52^1^2 ^^"^ Ps2i3\S2a- 
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Consider any non- negative pair (a, b) and any A G A'^^ Since the probability of error 
goes to as n — i> oo, by Fano's inequality there exists a sequence e„ — > such that 

n{aRi + 6i?2 — (« + b)en) 

(2) 6 9 

i=l i=l 
6 9 

+ Y ^2.A^2 ; Y,% V,%) + Y f^2^I{X-; Y,l, V,-J. (144) 

i=l 1=1 



Note that in step (1), we split up a and b according to flllSp and (11211) . considering 
decoders under different states. In step (2), we consider genies which provide different 
side-information V's to the decoders. Consider, for instance, the term z^iiJ(X"; Y{^g, V{{p). 
We will choose the side-information V{{p in such a way that we can form a correspon- 
dence between this term and the term contributed to the inner bound by the right hand 
side of the constraint (12^ . In particular, we choose the genie provided side-information 
V^i^ to match the error-event corresponding to (!24|) . More specifically, we note that 
the corresponding error-event is when receiver 1 in state (3 correctly decodes the other 
user's common information U213, and its own common information (t/1/3, Uia), but makes 
an error in decoding its private message. Hence, the genie provides the side-information 
{Ui^, Uip, U213) which can be shrunk to V7i/3 = {^lai ^2/j) because of the Markov relation- 
ship between , and U^^. Now, we expand the term /(X"; 17^, V^n/3) to get (I145p . 
We can repeat these two steps for every term in (11441) : the (expanded) upper bounds on 
all the terms are given in ( 1145p -( fT74|) . 



I{X--Y-p,Vi{p) 




I{Xi-Y-p,U^^,U^p) 


= H{Yrp\ 


ic^ra, u^p) - H{siip\u^p) + ij(c/rj 




(145) 




A, 


/(xr;yi"^,c/rj 


= H{Y-p\ 


PL) - H{Sqp) + H{UL) H{UL 


i^r) 


(146) 


I{X--Yll^Vl],0) 




I{Xi; Y{p, U"p, U213) 


= H{Yl}3\ 


\U^p, U^p) - H{S^ip\U^p) + H(Ul}j) 


-H{U^p\ 


1^1") 
(147) 


I{X--Yrp.V,\f,) 




I{X--Y-p,U^p) 


= H{Y-p\ 


|f/J» - i7(5^y + iJ(C/r^) - H{U^^ 


\x-) 


(148) 


i{x--Y-^,v:^,^) 


A^ 


I{X-;Y-p,U^p) 


= HiY^pl 


\U^p)-H{SqfAU^p) 




(149) 


I{X--Y{^p,V^,p) 


A^ 


I{X--Y-^) 


= H{Yl^\ 


) - H{Sh) 




(150) 
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^ I{X-;Y,l,U^^,U^J 


= H{Y,l\U^^, - HiS^jU^J 4 




~H{U{\\X^) 
(151) 


IiX^;Y,l,vr2^) 


^ I{X'^;Y,l,U^^,U^p) 


= H{Y,l\K^,U^p) - HiS^M) 4 




-HiUUX'i) 
(152) 


IiX-;Y,l,Vr,J 


^ I{X-;Y,l,U^J 


= Wi"jc/rj - ^(^L) + 




m (153) 




^ I{X-;Y,l,U^^,,U^J 


= HiY,l\Kp, C/2-J - HiSUU'2'a) 4 


^ H{U^p) 


-H{U^p\X^) 
(154) 




A t/ '\^TI, '\rTI, ttT) t tTI, \ 

= liX'l^Y^^^U'^p.U^p) 


TT/TT"??, \ T TTI, T TTI, \ T T / i~fTI, \ T TT) \ 1 

= HiY{l^\U^p, U^p) - HiS^jU^p) 4 




-^^(£^1/3 1^1) 

(155) 


I(X-;Y{l,Vr,J 


^ I{X^;Y,l,U^p) 


= H(Y,l\Ul^i,) ~ H{S^2'.) + H{U^p) 




\X-) (156) 






— -'^\^la\^2a) -"W2qI^2q7 




{^o^ ) 


T(X^^-Y^^ 1/" 1 




— -'^ \^ lal'-' 2fJ ) l'-'2al'-^2/37 










= HiYZ) HiS-J 




(159) 


I(X2; Y2P, V2113) 


^ I{X-;Y2%U^^^,U^^) 


= H(Y-p\U^^, U^p) - H{S'^i,\U^f,) 4- 




-H{U^JX-) 
(160) 


T( "V^^i T/^ \ 
1-^2 ' -'2/3; ''2207 


A T/ -yn -w-n Tin \ 
— ^ 1^2 ' ^2/3' f-^2aJ 


= H[Y2p\U2j - H[S^i^) + H[U2a) 


LJ /TJTl 


l^n) (161) 


-^(-'''2 ; ^2*^3 ! ^23/3) 


— [^2 J -'2/31 '-^2/31 '-^1/37 


= H{Y-p\U^p, Vlp) - U{Slp\Ulp) + 




-H{U^p\X^) 

(162) 


1^2 I ^201 ^240) 


— ^ [^2 J -'2/3; 1-^2/37 


— ^\^2f3W2p) ^\^lf3) + -"[^2/3) 


- TJiTT"- 
\'^2f3 


^2 7 V-'-O'^J 


HX2; Y^p, V25p ) 


^ IiX-;Y2%U^^) 


= HiY-p\U^l,)-HiS^p\U^f,) 




(164) 


I{X2i Y^p, V2Qp) 


^IiX^:Y^p) 


= H{Y^p) - H{Sl'p) 




(165) 


I{X^;Y2l,Vi[^) 


^ HX^;Y2l,UL,U^o.) 


= H{Y2im^, U^^) - HiS^JU^J 4 




-F((72"JX2") 
(166) 


IiX^;Y2l,V^^J 


= I{X^;Y2l,U^^,Ul'p) 


= HiY2l\U^^, U^p) - HiS^U^p) 4 




-^(C^2al^2) 

(167) 


I{X-;Y-^.v;i^) 


I{X-;Y2l,U^J 


= H{Y2l\U^^) - H{S[^^) + H{U^^) 


- H{U^^ 


1^2") (168) 


I{X^:Y^^.Vi\^) 


^ I{X-;Y2l,U^0,U^^) 


= H{Y2l\U^p, C/rj - H{Sl\\Ul^^) 4 


- H{U^p) 


-H{U^p\X-) 
(169) 


i(x5;Y2l,V2lJ 


^ I{X-;Y-^,U^f,,U^p) 


= H(Y2l\U^p, C/r^) ~ HiS^U^f,) 4 




-i/(C/^'^|X^') 
(170) 


IiXl.Y2l,V2lJ 


^ I{X-;Y2l,U^p) 


= ^(5"2"JC^2;3) - H{S[\) + H{U-p) 




1^2") (171) 


/(^2";>^2o,^27a) 


^ I{X-;Y2l,U^J 


= H{Y-^\U^^)-H{SUU^^) 




(172) 


/(^2;>^2o,^28a) 


^ I{X-;Y2l,Ul^,) 


= H{Y-^\U^p)-H[SUU^p) 




(173) 


I{X2 ; Y2a , V"2gQ, ) 


= nx^;Y2l) 


= H{Y-^) - H{Sl^J. 




(174) 
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Continuing with our outer bound derivation, from fll44p . 



n{aRi + 6i?2 — (a + 6)e„) 

i=l i=l 
+ + Z/12) + (/ill + yUi2 + /il3)} + i/(f/i'»{(z/i3 + Pu) + (/il4 + /^15 + /iie)} 

-//(5l"„){(/X23+/i26 + /^29)} - ^(.5i"^){(//22 + 1^24 + 1^26)} 

- HiUUX'Diivn + //12) + (/ill + /ii2 + /xis)} 

- H{U'^p\X'^){{v^^ + + (/ii4 + /^i5 + /iie)} 

-//(5rj^rj{(^21+/i24+/i27)} - i/(5r^|f/!»{K + ^23 + /^25)} 

-//(5rJ^r/3){(/^22+/i25+/i28)} 
6 9 

i=l i=l 
+ ^(t^2a){('^21 + ^^22) + (/^21 + /i22 + /i23)} + ( 6^2"/? ) { ( ^23 + 1^24) + (/i24 + /^25 + /^26)} 
-^('52a){(^13 + /il6 + /^19)} - i^(.52"^){(/^12 + 1^14 + 1^16)} 

- H{U1^^\X1^){{U21 + 1^22) + (/i21 + /i22 + /^23)} 

- //(f/2"/3l^2"){('^23 + 1^24) + (/i24 + /X25 + l^2(>)} 

- H{SUUl^Ml^,,+ ^^,, + ^^,,)} - H{S^0\U1^0){{v,, + v,:, + v,,)} 

- H{S^,\Ul^p){{ix,2 + /ii5 + /iis)} (175) 

6 9 

^z.i,/7(y,",|y^^) + 5^/xi.//(n"jyi'jj 

i=l 1=1 
+ i7(t/f^){(/t22 + /i25 + /i28)} - H{U'^p){{n22 + /i25 + Ai28)} 
-//(5rJt/[;3){(/i22+/i25+/^28)} 

- if (t/i;|Xf){(/i22 + /^25 + /i28) + (/^23 + /i26 + /i29)} 

- //(f/f^lXf ){(z/22 + 1^24 + 1^26) - (/i22 + /^25 + /i28)} 

-//(5rjt/rj{(/Z21+/i24 + /i27)} - H{S'i^\U'^^){{u2l + U2, + V2,)} 

6 9 
+ Y.^2^H{Y^,\V^,,) + 5^/i2.//(r2"Jy2'IJ 

i=l i=l 

+ ^(f^2a){(/^12+/il5+/il8)} - i/(f/2";3){(/^12 + Ail5+/il8)} 
-m"Jf/2';3){(/^12+/il5+/il8)} 

- //([/2"„|X2"){(/ii2 + /Xi5 + /iis) + (/il3 + /^16 + /^ig)} 

- H{Ul^p\X'^){{u^2 + 1^14 + i^ie) - (/il2 + /il5 + /iis)} 

- ^(^2jt^2"J{(^ll + /il4 + /il7)} - //(52".|f/2".){(z/ll + Z/13 + /^is)} (176) 
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1=1 i=l 

- /7(?7f„|Xf){(/i22 + /i25 + ^28) + (/i23 + /i26 + 1^29)} - if ( f/f^ | ) { ( 1^22 + 1^24 + 1^26)} 

-i7(5rJ^r){(/"21+yU24 + /i27)} - ii(5r^|^r){K + /^23 + ^^25)} 
6 9 

+ ^2^H{Y,-,\V,%) + ^ ^l2^H{Y,l\V,-J 

i=l i=l 

- H{U^JX^){{^ii2 + /il5 + A^is) + (/^13 + /il6 + yUig)} - i/(t/2"/3l^2"){(l^l2 + i^l4 + ^^le)} 

- ii(52"J^2"){(/^ii + f^u + /iir)} - H{S^p\X^){il^^^ + + ^15)} (177) 

6 9 

i=l 1=1 

9 



6 9 
+ 5^ Z.2.ii(1^2'^^m'|^) + 5^ ^^2^H{Y,l\V,-,, 
i=l i=l 

- //(52"J^2) f E/^H ) - ii(52,l^2) I E^lO • ^1^8) 



i=l / \i=l 



Here, 



to get inequality (a), we used fll45p - fll74p in (11441) and collected the terms together; 

for equality (b), we used Proposition [1] along with the facts 

HiU-^) = HiS-^), (179) 

H{U^f,) = HiS^^), (180) 

H{U^J = H{S^J (181) 

HiU^f,) = H{S-p)- (182) 

inequality (c) follows from the fact that conditioning reduces entropy. In particular, 

H{U^.) - H{U-,) - H{SUU^,) = -H{U^,\S^^) < -HiU]:,^ (183) 
H{U^J - H{U-^) - H{S^JU^^) = -H{U-p\S-^) < -H{U-^\X-)- (184) 

for equality (d) we used 

HiUUX^) = H{SUX^), H{U-,\X-) = H{S^f,\X^). 
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Now we single-letterize using the chain rule along with the fact that the channel is mem- 
oryless and conditioning reduces entropy. 



^ n r 6 9 
aRi + bR2 - (a + 6)e„<- <j i^iiH{Yif,{q)\Vuf3{q)) + 



q=l (_ i=l i=l 

H{S,^{q)\X,iq)) (J2^^2^ 



H{S,^{q)\X,{q)) lJ2l^2^ 
\i=i 

6 9 

J2'^2^H{Y,p{q)\V,M) + Y,^^2^H{Y2^{q)\V2M) 

i=l 



,i=l 



i=l 

5^ ^2.) i/(5i„|Xi,g) - \ y,^2A H{Sip\Xi,Q) 

vi=l / \i=l / 
6 9 

+ J] 1/2.^^(1^2/31^2^/3, Q) + Y1 ^^2^H{Y2a\V2^a, Q) 
=1 1=1 

E/il, ] i/(S'2„|X2,g) - f J^^^l.) //(52/3|^2,Q) 



i=l / \j=l 



(186) 

where we set (Q, ?7i/3, t^ia, -'^i, •S'l/j, S'iq, f/2/3, U2a, X2, 5*2/3, 'S'2a) to be joint random variables 
such that Q is uniformly distributed over {1, 2, . . . , n} and, 

Pr (f^l/3, Uia, Xi, Sia, S'i/3, ^72/3, U2a, -^2, 'S'2a, 5'2/3|(5 = Q) 

= Pr ([/i^(g), t/i„(g), Xi(g), 5i,(g), V(g), U2f3{q), U2a{q), X2{q), S2a{q), S2M) > (187) 

for 1 < q < n. Since the messages are independent for the two users, so are Xi{q) 
and X2{q). Therefore, {Q, Xi, X2) satisfies the Markov chain Xi — Q — X2. Further 
because of our choice of (Uiisi^q), Uia{q), Uipi^q), Uia{q)), the random variables satisfy the 
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condition (158|) . Hence the random variables (Q, Xi, Uia, Uip, X2, U2a, U2p) belong to the 
sub-family of V that we described earlier, whose elements are defined by ((5,Xi,X2). 

We are now ready to formally define TZoutiQ, -^11-^^2): 



noutiQ,X,,X2) = {(i?i,i?2) : i?i > 0, i?2 > 

^{out) 



ai?i + bR2 < c;°tl(Q,Xi,X2), VA e AU, Va > 0, 6 > 0}. 



We have proved that if {Ri, R2) is achievable, then 

(i?i,i?2)G U nout{Q,X,,X2). (188) 

Q,Xi,X2 

This completes the proof. □ 



5.2 Proof Of Theorem [3] (ii) 

For a given {Q, Xi, X2) such that Xi — Q — X2 is a Markov chain, we need to quantify the 
gap between TZoutiQ, ^i, ^2) and 7lin{Q, Xi, X2), which are defined by Equations (11311) 
and (I142p respectively. In order to do this, we quantify the gap between c^"xab)(Q^ "^2) 
andcj^),)(g,Xi,X2). 

'^(AiV^'"^l'^2) - cj^"^„)((5,Xi,X2) 

= {H{S^^\U^^,Q) - H{S^^\X^,Q)) (^^fi2}j + {H{S^p\U^f,,Q) - H{S^p\X^,Q)) 1^2. 

+ {H{S2a\U2a,Q) - H{S2a\X2,Q)) ( /ili ) + (^(^2/3 1 1/2/3, Q) " ^(^2/3 , Q) ) [j^"^' 

\i=l / \i=l / 



, I^2i 



+ I{S2a,X2\U2a,Q) + /(52/3; ^2 1 f/2,3 , Q) 



< bmax{I{Sio,; Xi\Uia, Q),IiSip; Xi\Uip, Q)) 

+ amax(/(5'2a; X2\U2a, Q), I{S2I3] X2\U2p, Q)) 

< aA,{Q, Xi, X2) + 6A2(g, X,, X2). (189) 
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Here ^i{Q, Xi, X2) and A2(Q,Xi,X2) are defined as follows: 



Ai(Q,Xi,X2) ^max(J(52,;X2|^2a),/(^2/3;X2|f/2/3)), 
A2(Q,Xi,X2) ^max(J(5i„;Xi|[/i,),/(^i^;Xi|f/i^)). 



This completes the proof of Theorem [31 □ 



5.3 Proof Of Corollary [6] 

Consider the 2-state compound Gaussian interference channel. For this special case, we 
have the following result that identifies the Gaussian code books to be sufficient. 

Lemma 9 

7^o,i(Q,Xl,X2) c nout{Q\xix;) (190) 

where Q* = 1, X* ~ CA^(0,Pi), X* ~ CN{0,P2). 

We note for easy reference that TZoutiQ, ^i, ^2) is defined in Equation (I142p . 
Proof: It suffices to show that 



^t£b) ^i^^2) < C(^"„*Jfe) {Q* , XI ,X*), 



where c|^"^^^^((5, Xi, X2) is as defined in f ll86p . 

6 9 

i=l 

^/^2i ) hiS,^\X,,Q) - (j2iy2i] hiS,f,\X,,Q) 



J=l / \i=l 

9 



^ iy2ihiY2(3\V2ip, Q) + '^ tJ'2MY2a\V2ia, Q) 
-l 1=1 



, j=l / \i=l 



The terms h{Sia\Xi,Q),h{Sip\Xi,Q),h{S2a\X2,Q) and h{S2i3\X2iQ) are the differential 
entropies of complex Gaussian noise with known variance and are readily handled. Let 
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us now turn to the term ^(yi/jlVii/j, Q): 

h{Y,p\Vnp, Q) = h{Y,p\U,^U2p, Q) (191) 
= J2p{q)h{Yip\UiaU2/3, Q = q) (192) 



q 



9 





r^2i/3 


2 p 
Ag 


^21/3 


PA. + 1 



< log fn-^^ + 1 + , '"T'^:. ) (194) 





K^21/3 


PA 


^^■21/3 


PP2 + 1 



,|/il2aPA + l 

Mn*^|t^raf^2/3,Q*)- (195) 



Here, 

• in step (a), we denoted 



E[\Xk\^\Q = q]=Pk„ k=l,2 (196) 



and used the fact that conditional differential entropy is maximized with the Gaus- 
sian distribution under a covariance constraint (Lemma 1 [6]); 

• in step(b), we used Jensen's inequahty. 

A similar argument follows for the other terms. To conclude, we have shown that 

ct:UQ^X^^X2) < c|;;%(Q*,Xr,X*). (197) 
This completes the proof. □ 
Finally, we can readily see the proof of Corollary [61 This is because, 

U noutiQ,x^,X2) = nout{Q\xix;), (i98) 

{Q,Xi,X2) 

direct consequence of Lemma [91 

6 Discussion: Insights On The Non-Compound In- 
terference Channel 



In this section we consider the non-compound interference channel model introduced in 
[5]; this is a specific instance of our model and is obtained by setting a = p. Our results, 
when specialized to this instance provide an alternative derivation of the results of Chong 
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et al. [3] and Tse and Telatar [5]. Below we briefly sketch our results with an aim to 
compare and contrast the different proofs. The goal is not only to give better insight 
into existing results, but also to give an idea on how our new proof technique scales 
more naturally to the 2-state compound interference channel (and in general to the n- 
state compound interference channel that we will describe in the next section). We first 
describe the achievable scheme and the inner bound. Following that, we will describe the 
outer-bound, focusing on contrasts between the different approaches. 



6.1 Achievable Scheme 

The special case of the noncompound version is obtained by setting 

Skl3 = Ska = Sk (199) 

and, correspondingly, 

Uk(3 = Uka = Uk (200) 

for A; = 1, 2. We also set 

Rka = 0. (201) 

We rename Rkp as Tk and Rkp as Sk to be consistent with the notation of Chong et al. 

m- 

The superposition achievable scheme can now be described by joint random variables 

P=(g,t/i,Xi,[/2,X2) (202) 

with the joint distribution factoring as 

p{q)p{xi\q)p{x2\q)p{ui\xiq)p{u2\x2q). (203) 

From Section l4?n it follows that any rate vector {Si, Ti, S2, T2) that satisfies, 

5i </(ri;Xi|f/i,f/2,Q), if5i> 0, (204) 

T2 + Si<I{Yi-XiU2\Ui,Q), if5i> 0, (205) 

Ti + 5i </(Fi;Xi|f/2,Q), ifri + 5i> 0, (206) 

T2 + Ti + ,Si </(Fi;Xif/2|Q), ifTi + 5i> 0, (207) 

S2<I{Y2-.X2\U2,Ui,Q), if52> 0, (208) 

Ti + S2<I{Y2]X2,Ui\U2,Q), if-S2> 0, (209) 

T2 + ,S2 < /(F2; Xsif/i, g), if r2 + ^2 > 0, (210) 

Ti + T2 + S2< /(I2; X2, Ui\Q), if T2 + 52 > 0, (211) 

5i,ri,52,T2 >0, (212) 
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is achievable. Define the 4- dimensional region 

= {{Si,T,,S2,T,) : satisfies (M-dOT)} (213) 
and its projection on the 2-dimensional space 

n,n{P) = {{Ri, R2) ■.Rk = Sk + n,k = 1, 2} . (214) 

On the other hand, define 

T^iniP) = {{Si,Ti, S2, T2) : satisfies ^j-^^} . (215) 

Si<I{Yi;Xi\Ui,U2,Q) (216) 

T2 + Si<IiY,;X^U2\UuQ) (217) 

T, + S^<IiY,;X^\U2,Q) (218) 

T2 + T1 + Si< IiYi;XiU2\Q) (219) 

S2<HY2;X2\U2,U,,Q) (220) 

Ti + S2<IiY2;X2,U^\U2,Q) (221) 

7^2 + ^2 </(>^2;^2|^i,g) (222) 

Ti + T2 + S2< /(F2; X2, U,\Q) (223) 

51 + n> 0, (224) 

52 + T2> 0. (225) 

Let its projection on the 2-dimensional space 

nUP) = {{Ri,R2) : Rk = Sk + n,k = 1, 2} . (226) 

In Theorem 2 of [3], the authors explicitly evaluated the constraints that define this set 
and described it as the "compact version" of the Han-Kobayashi region [1] (which results 
from a somewhat different coding strategy, as compared to the superposition coding one). 
However, we know from Lemma [7] that 

nUP)^'R'in{P)- (227) 

We thus conclude the alternate proof of [3] (Theorem 2). Our approach differs from the 
approach of Chong et al. [3] in two ways: 



• It is instructive to observe the similarities and differences between the 4-dimensional 
achievable region 'r!i^{P) to the one in [3j (Lemma 3). First, the inequalities involved 
are the same. Howevber, several of these constraints are inactive when the boundary 
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conditions on the data rates bite. We can immediately conclude that our achievable 
region {iz\^{P)) is in general a superset of the region in [3]. This is somewhat 
surprising since the encoding method in both cases is superposition coding. The 
differences result due to our careful consideration of the error events in the decoding 
process. 

• Chong et al. [3] described the 2-dimensional region explicitly by carrying out the 
somewhat tedious algorithmic procedure of Fourier-Motzkin elimination. Further, 
they showed that a potentially bigger region (the compact description region) is 
achievable by time-sharing between two other schemes defined by (Q, 0, ^i, X2) 
and (Q, Ui,Xi, 0, X2). In our approach, we entirely avoid describing the 2-dimensional 
region explicitly. Further, we showed that there is no need to time-share between 
any other schemes, to achieve 7lin{P). 

6.2 Outer Bound 

For a given P = {Q, Ui,Xi,U2, X2), the inner-bound region in Chong et al. [3] is described 
by seven linear inequalities involving i?i and R2. In [5], Telatar and Tse picked a specific 
choice of {Ui, U2) given by 

p{ui,U2\q.,Xi,X2) = ps^\xAui\xi)Ps2\X2{u2\x2)- (228) 

In deriving the outer bound, Telatar and Tse [5] gave extra information to the receivers 
(the so-called "genie-aided" approach) to handle the seven inequalities. The rationale to 
what side information the genie should provide to handle the different linear inequalities 
was somewhat speculative (cf. Section IV [5]). 

Our approach avoids an explicit representation of the inner-bound. This higher level 
description allowed us (cf. Section 14.21) to show that any inequality involved in the pro- 
jected region can be obtained by linear combination of the inequalities fl216p - (12231) . Fur- 
ther, each inequality in (I216p - (I223I) arises from a typical error event consideration. We 
now have the operational insight into what side information to give when. We demon- 
strate this process in the instance of Equation ( 1216^ . This inequality must be satisfied 
to ensure that the Receiver 1 decodes its own private message, on the condition that it 
can decode both the public messages correctly. This suggests that corresponding to this 
inequality, we may give the side information ([/", f/;^). A similar argument handles each 
of the other inequalities (l2T6|) - (l223l) . 



7 A^-state Compound Interference Channel 

In this section we consider the natural extension of the 2-state compound interference 
channel to an A^-state compound interference channel. Our earlier results (both inner 
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and outer bounds) also generalize naturally to the more general A^-state model. 



7.1 Model 



The iV-state compound interference channel is depicted in Figure El Each receiver can be 
in one of the possible states denoted hj ai, a2, ■ ■ ■ , a^- 





►- 


/la 2 





PS2„i|X2 






PS'2c2lS2ai 





^1.2 



/l. 



PS2ajvlS2a(„_i) 



X2 



Y2a 



Figure 3: The A^-state compound interference channel model. 



7.2 Results 



We can characterize the inner bound and outer bounds to the capacity region in a way 
similar to the 2-state compound channel. 



Inner Bound 



Our coding scheme is + 1-level superposition coding. This is much along the lines of 
the 3-level superposition coding employed for the 2-state compound interference channel. 
The coding scheme is characterized by jointly distributed random variables 

{Q, Xi, Uiaj^, . . . , Uia^, X2, U2ai, ■ ■ ■ , f^2aAr) (229) 

which satisfy the Markov chain 

f^lajv ~ ■ ■ ■ ~ Uia-^ — Xi — Q ~ X2 — U2ai — ... — t^2«jv- (230) 

As earlier, we restrict ourselves to a subfamily of the jointly distributed random variables 
uniquely determined by {Q, Xi, X2) in the following way: 
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Given {Q, Xi, X2), we pick random variables 

{Uka^, n=l,...,iV, k = l,2}, (231) 
such that they have the same joint distribution as 

{Ska„, n=l,...,N, k = l,2}, (232) 
but are independent of them. 

Using these random variables, we generate the (A^ + l)-level superposition random code 
books for each user with rates {Riaf^ , . . . , Ria^^ , Rip) and {R2aN, ■ ■ ■ , R2ai, R2p) respec- 
tively. 

The decoding at each receiver is jointly typical set decoding. It is similar to the 
decoding described for the 2-state. Each receiver tries to decode fully all of its own 
messages, but only partially decodes the other (interfering) user. This strategy can be 
seen as an opportunistic strategy where the extent of the interference that the receiver 
decodes depends upon the level of interference it sees. 

The remainder description of the achievable rate region follows the same development 
pattern as for the 2-state compound channel. It would be impractical (in terms of the 
length of the descriptions) to explicitly detail this description. As such, we briefly itemize 
the main points in the achievable region description below. 

• We first have an achievable rate region 

T^1^'^^\Q, X2) in 2(A^ + 1) dimensions 
along the same lines as fillip (we have avoided the explicit description of the linear 
inequalities describing the region due to the tedium and length involved in doing 
so). As earlier, let '}Zin{Q, Xi, X2) be the projection onto the 2-dimensional space 
(i?i, R2) where, 

i?l = Rlaj^ + . . . + Rlai + Rip, R2 = R2aN + • • • + -R201 + R2p- (233) 

We have that TZiniQ, Xi, X2) is achievable. 

• We next define 7^^i^+^^(Q, Xi, X2) generalization of (123|) and define its projec- 
tion onto the two dimensional space TZmiQ, Xi, X2). Lemma[7]can be appropriately 
generalized to show that 

7^,„(Q,Xl,X2) c ni„{Q,XuX2), (234) 

thus proving that 7lin{Q, Xi, X2) is also achievable. 

• We next characterize an extremal representation of TZmiQ, -^2), using an appro- 
priate generalization of (11311) to the A^-state model). In other words, we represent 
it as an intersection of hyperplanes, where the inequality used to define the hy- 
perplane can be obtained as a linear combination of the inequalities used to define 

nt-'\Q,x„X2). 



32 



Outer Bound 

An outer-bound TZoutiQ, ^i, ^2) can be derived with an extremal representation that 
is similar to the corresponding one for the inner bound TZmiQ, Xi, X2) (this step is a 
natural generalization of fll42p ). In deriving the outer bound, we use appropriate genie- 
aided techniques (that involve providing suitable side information to the receiver). Again, 
what side information is shared is decided based on the typical error events which lead to 
the corresponding inequality in the inner bound. 

Gap 

Finally, we characterize the gap between the outer and inner bounds to the capacity 
region for the n-state compound channel, in much the same way as we did for the 2-state 
compound channel. This is stated formally below. 

Theorem 10 For the N -state compound interference channel of Figure\^ if {Ri^R^) is 
in the outer hound to the capacity region, then {Ri — Ai, R2 — A2) is achievable, where 

Ai(g,Xi,X2)= max /(X2; ^2aJf/2aJ, (235) 
l<n<A'' 

A2{Q,X,,X2)= max I {X,; S,^JU,^J . (236) 

l<n<A' 

Specializing to the deterministic version, we can see that this gap is zero and hence 
the capacity region is characterized exactly. Specializing to the Gaussian version, we can 
see that this gap is no more than one bit. This completes the extension to the A^-state 
compound channel scenario. 

7.3 Discussion 

A few comments on the structure and properties of the achievable scheme are in order 
here. 

• Note that the structure of the achievable scheme (or the power split in the Gaussian 
scheme), which is characterized by the joint random variables 

(Q, Xi,Uiai, ■ . . , Uiaf^, X2, U2ai, ■ ■ ■ , t^2ajv) ) (237) 

depends only on the interference states and not on the deterministic functions fka^ ■ 
The functions fka„ however may still help in determining the actual achievable rate 
region. 
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We highlight this point by considering the case when each of the degraded interfer- 
ence channels in our model are identity, i.e., 



Ska2 ~ Ska\ — ... — Skaff: k — 1,2. (238) 

For this model the "compoundness" of the channel is only due to the functions fka^ ■ 
Indeed, only two levels of superposition coding suffice, much as in the noncompound 
version of the problem. 

Let us assume 

Sla2 = Siaj^. (239) 

Then our achievable scheme sets 

Uia2 = Uia,. (240) 

This implies that the level of the code book corresponding to Uia2 is "degenerate" 
and that we might as well set 

Rla2 = 0. (241) 

Suppose, however that 

fla2 7^ /la, (242) 

and hence the two receiver states Yia^ and Yia^ are not the same. While the receiver 
in either state adopts the same decoding technique (with respect to the level of 
interference it decodes), the higher dimensional constraints on the rate vector, as 
imposed by the decoding condition for each state, are different. Nevertheless, we 
see that for the Gaussian case one of these states is always worse than the other 
and thus would be the critical bottleneck in determining the achievable rates; this 
is done next. 



8 The Compound Gaussian Interference Channel 



8.1 Model 



The scalar Gaussian interference channel is defined by the complex channel parameters 
(/ill, h2i, hi2, h22)- The finite state compound channel version of it allows these parameters 
to take values in a finite set A. 

A = {{hii, /l2l, hi2, /i22)l, (/ill, /i21, hi2, /l22)2, • • • , (/ill, /i21, /il2, h22)\A\} ■ (243) 

Define 

A - {(/iifc,/i2fe)| (/iii,/i2i,/ii2,/i22) G A; = 1,2, (244) 
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Observe that the channels from the two transmitters to the receiver k are defined solely 
by the parameters {hik, /i2fc)- Therefore the set A^. is the set of states that the receiver k 
can take. Now define A' as 

A' = Aix A2 

= {{hu,h2uhi2,h22)\ {hu,h2i) e Ai, {hi2,h22) e A2} . (245) 

In other words A' allows for all combinations of the possible states for both the receivers. 
Let C{A) denote the capacity region of the compound channel defined by the set A. We 
have the following proposition: 

Proposition 2 

C{A)=C{A'). 

Proof: Note that A C A'. Thus it is clear that any scheme that works for the compound 
channel A' also works for the compound channel A. However, since the two receivers do 
not cooperate, only the marginal channels to each receiver decides the decodability of any 
communication scheme. We now conclude that a scheme that works for the compound 
channel A also works for the compound channel A'. This completes the proof. □ 

In the light of this observation, we can, without loss of generality, consider finite state 
compound channels whose state set A decomposes as Ai x A2. 

In Section [2] we saw that the case where the cardinality of Ai and A2 is restricted to 
2 is captured by the 2-state compound interference channel of Figure [21 Analogously, the 
general case where |^i| and \A2\ are finite (with cardinality no more than A^) is captured 
by the A^-state compound interference channel of Figure [31 We see this formally below. 
The key point is the infinitely divisible nature of Gaussian statistics. This aspect was used 
to show that the scalar Gaussian broadcast channel is always stochastically degraded. In 
a similar vein, the compound scalar Gaussian interference channel can always be supposed 
to have degraded interference states. 

We begin by noting that if 

\Ai\^\A2\, (246) 
then we can add redundant duplicate copies to one of the sets, so that 

\A,\ = \A2\. (247) 

Therefore, without of loss of generality, we suppose this is true.: 

\Ai\ = \A2\ = N. (248) 

Then, order the finite sets Ai and A2 such that 



\h21al 


> 


\h2ia2 




. > 


\h2iaM 


\hl2ai 


> 


\hi2a2 


> . , 


. > 
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Next, we do the following substitution to reduce the finite state Gaussian interference 
channel to the model of Figure [31 



Slai — huai^i + Z 
iJlan — , '-'la(„_i) 



2a„ 



7 'S'2a(„_i, 





hl2a„ 




(- 


1 






/ 

1 - 

\ 






^21a(„_i) 


1 



1/2 



^ia„, n = 2, ...,A^, 



1/2 



^2a„, n = 2, ...,A^. 



(249) 

(250) 
(251) 

(252) 



Ylan — fla„{Xi, S2an) — ^lla„-^l + S2a„, 1 < U < N, 
^2a„ = /2a„(^2, 'S'la^) = /i22a„^2 + ^ic,,,, 1 < 72 < A^. 



(253) 

(254) 



Here Zka„s are independent complex Gaussian random variables with unit variance. 
Note that the function fka^ captures the direct link gains hn and /i22- The channels 
p{'Ska„\Ska^„_:^f) capturc the cross link gains hu and /121 as well as the additive noise. 



8.2 Main Result 



We are now ready to summarize the main result of this paper. 



Theorem 11 For the finite state compound Gaussian interference channel, multilevel 
superposition coding with Gaussian code books and opportunistic decoding depending on 
the interference state is within one bit of the capacity region. 

Proof: We have shown earlier in this section that any finite state Gaussian interference 
channel is captured as a special case of the model in Figure [H Specializing the result 
of Theorem [10] to the Gaussian case, we have that the multilevel superposition coding is 
within one bit to the capacity. Further, it suffices to only consider Gaussian code books 
in the superposition code (along the same lines as Corollary [6]) . □ 

8.3 Discussion 

A few remarks are in order now. 
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1. While we have restricted both the direct-hnk gains {hn and /122) and the cross-hnk 
gains (/ii2 and /i2i) to a finite set of values so far, it turns out that we can relax this 
assumption for the direct link gain. In particular, suppose 

(/ill, /i2i), (/i'li, h2i) e Ai, \hn\ < |/i'ii|. (255) 

These correspond to two states of the receiver 1, which differ only in the direct link 
gain, but have the same cross link gain. As observed in the previous section, for 
either of the two states, the receiver adopts the same decoding method. Further, 
since we have restricted ourselves to Gaussian code books, we see that the perfor- 
mance is restricted only by the state that has the weaker of the two direct links: in 
this case, it is the one with parameters (/iii,/i2i) To summarize: 

If a rate vector is achievable for the state {hu, /i2i), then it is also achiev- 
able for {h[i, h2i). 

Therefore, at any receiver, for a fixed cross-link value the direct-link gain at the 
corresponding receiver can take on values in a set. This set could be infinite. The 
receiver state that has the weakest direct link is the bottleneck. 

2. At any receiver, the set of unique values the cross- link gains take is assumed to be 
finite. This finiteness assumption appears to be critical since the number of levels 
required in the superposition coding at the interfering transmitter depends on it. 
If the cardinality of the set is A^, then the number of levels in the superposition 
coding is + 1. It is an open question to determine if a finite number of levels of 
superposition coding suffice to handle a continuum of interference cross-link gains. 



A Analysis Of Probability Of Error 

In the following we consider the decodability conditions at receiver Rxi/3 only. A very 
similar analysis applies to the other receiver-state pairs. 

Due to the symmetry of the random code book generation, the probability of error 
averaged over the ensemble of random random code books, does not depend on which 
codeword was sent. Hence, without loss of generality, we can assume that the messages 
indexed by 

(ji, A;i, h) = (1, 1, 1), (J2, A;2, k) = (1, 1, 1), (256) 
were sent by the two transmitters respectively. Let us define the following event 

Ejklm 

{ {Q\ U^p U) , f^fa U, k) , Xr (j, k, I) , (m) , Y,^^) e (Q, U,p, [/i„, Xi, U2p, Y,p) ] . 
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Letting Pi"'' denote the probability of decoding error at Rxi^ we have 

Pi") = P (^{UmEinmT U U(,, fc,0^{l,l,l)^ifc;m) (257) 

<P((U„£;iii, 



im J 



(a) 

5^P(Enzi)+ J2 P(Enim) 

1^1 l^l^m^l 



^ ■' ^ 



Ikl rn y 



(d) (e) 

+ 5^ P(^,m)+ 5^ (258) 

^ ^ ' ^ ^ ' 

{/) (9) 

The final inequality used the union bound. Let us consider each term in (12581) and study 
the conditions needed to make it go to asymptotically (in n). 

• It is straightforward to see that (a) goes to as r?, — > cxd. 

• Now consider (b). We begin by noting that / G {1, . . . , 2"^^''}. Therefore if Pip = 
then (b) = 0. Else, 

(b) < 2'^^'^p2~^^^^^^i^''^^^^'^'^'^^f^'^''~^'^'' (259) 
Therefore for (b) to go to as n ^ oo, we must have 

Rip < IiY,fs;X^\Ui^,U2f3,Q), if Pip > 0. (260) 

• Similarly, (c) is if Pip = or P2/3 = 0. Else, it must be that 

i?2/3 + Rip < liY.fs; X,, f/2/3|f/i„, Q). (261) 

It is important to note that if P2/3 = 0, but Pip > then, (126 ip is redundant because 
of fl260p . Therefore for (c) to go to as n 00 (assuming that (6) goes to too), 
we must have, 

R2P + Rip < liYifs; Xu [/2/3|f/i„, Q), if Pip > 0. (262) 

Similarly for (d), (e), (/) and (g), we must have 

Ria + Rip < liYip- Xi\Uip, f/2/3, g), if Pla + Rip > 0, (263) 
R2f3 + Ria + Rip<IiY,f,;X,,U2f3\Uip,Q), ifPi« + Pip> 0, (264) 
Pi^ + Pi, + Pip</(ri^;Xi|f/2^,Q), if Pi^ + Pi, + Pip > 0, (265) 

R2(} + Rlf3 + Rla + Rlp<IiYi,3;X^,U2(3\Q), if Pi;3 + Pi„ + Pip > 0, (266) 

respectively. 
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B Proof Of Lemma [7] 



Consider any R2) G 7lin{P)- Then there exists an 

{Rip, Rla, Rl/3, R2p, R2a, -^2/3) ^ T^in i^) (267) 

such that, 

Rl = Rip + -Rla + Rl/3 and R2 = R2p + R2a + -^2/3- (268) 

We will find a 

(i?lp, -Rla, -R2p, R2a, -^2/?) ^ '^in (-P) (269) 

such that, 



"5 



-Rip + -Rla + -Rl/3 — -Rip + -Rla + -Rl/3, 
R2p + -R2a + -R2/3 = -R2P + -R2a + -R2/3) 

by the following algorithmic procedure. 
Step la) For /c = 1, 2, if Rk/3 < then, 

-Rfc/3 ^ 0, -Rfca ^ -Rfco + -Rfc/3- (270) 

step lb) For A; = 1, 2, if -R^a < then, 

Rka ^ 0, Rkp ^ Rkp + Rka- (271) 

Step 2a) For A: = 1, 2, if Rkp < then, 

Rkp ^ 0, Rka ^ Rka + Rkp- (272) 

Step 2b) For A; = 1, 2, if -R^a < then, 

-Rfca ^ 0, Rki3 ^ Rkf3 + Rka- (273) 

First up, we note that at each step we are ensuring that -Rip+i?ia+-Ri/3 and -R2p+-R2a + 
R2/3 stay invariant. Next, note that if -Rip, -Ria, -R1/3, -R2p, -R2a and -R2/3 are all nonnegative 
to begin with, then it is easy to see that 

(-Rip, -Rla, Rip, R2p, R2a, R2/3) ^ T^in (R) (274) 

and hence 

{Ri,R2)enUP)- (275) 
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Claim 1 At the end of Step lb, the new {Rip, Ria, Rif3, R2p, R2a, R213) still remains in 
TZf^{P) and satisfies 

Rla, Rip, R2a, R213 > 0. (276) 



Proof: Consider Step la. Note tliat in this step we are potentially increasing Rkfs, but the 
rest of the components either remain the same or decrease. Also note that in this step, we 
are keeping R^is + Rka invariant. Therefore, we only need to ensure that the inequalities 
among fl24l) - fl53l) that have Rkp-, but not R^a are not violated. This can be verified to be 
true, because of the polymatroidal nature of each block of the inequalities in (l24|) -(l53l). 
The argument is similar for Step lb. □ 



Claim 2 At the end of Step 2b, the new {Rip, Ria, Rip, R2p, R2a, R213) is in lZij{{P). 



Proof: Note that in Step 2a, the only component that potentially increases is Rkp, and so 
we might be violating one of the following constraints: (I24]),(l25]),(l30l)-(l32]),(l39^ and 
( H5|) - (l47|) . However, by setting R^p = 0, these violated constraints no longer matter for 

T^ini^)- '^^^ argument is similar for Step 2b. Note that at the end of Step 2b, we have 
ensured that all the components are nonnegative. □ 
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